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ATTN: PCT Legal Administrator (MPEP 1002.02(p)) 

Commissioner for Patents 
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It is requested that the above identified application filed under 35 U.S.C. 371 be 
converted into an application filed under 35 U.S.C. 1 1 1 (a). 

Attached hereto and re-filed herewith is a copy of the application, as previously filed, 
including specification, claims, abstract, drawings and declaration. Also attached hereto is a 
copy of the Priority Document (PCT/JP03/03987). 

It is requested that the fee for this Petition of $400.00 under 37 CFR 1.17(f) and any 
additional fees associated with filing of this Amendment, be charge to Deposit Account No. 19- 
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Sir: 



The above-identified application was inadvertently filed under 35 USC 371. 



08/15/E006 RKAYPftGH 00000116 10550489 



Respectfully submitted, 



01 FC;1462 



400.00 OP 



STAAS & HALSEY LLP 




1201 New York Ave, N.W., Suite 700 
Washington, D.C. 20005 
Telephone: (202)434-1500 
Facsimile: (202)434-1501 



AUG 0 9 2006 w ] Docket No.: 1466.1 104 

^fs. ^7 IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

In re the Application of: 
Satoshi FUKUI, etal. 

Serial No. Unassigned Group Art Unit: Unassigned 
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PRELIMINARY AMENDMENT 

Commissioner for Patents 
PO Box 1450 

Alexandria, VA 22313-1450 
Sir: 

Please amend the above-identified application, as follows: 



Serial No.: Unassigned 

IN THE SPECIFICATION: 

Please AMEND the specification by inserting before the first line the sentence: 

- This application is based on and hereby claims priority to International Application No. 
PCT/JP03/03987 filed on March 28, 2003, the contents of which are hereby incorporated by 
reference. - 
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Serial No.: Unassigned 



REMARKS 



The foregoing amendment to the specification is presented to perfect priority and/or 
parent benefit. 

If there are any additional fees associated with filing of this Amendment, please charge 
the same to our Deposit Account No. 19-3935. 

Respectfully submitted, 

STAAS & HALSEY LLP 



Date: September 26. 2005 




1201 New York Ave, N.W., Suite 700 
Washington, D.C. 20005 
Telephone: (202)434-1500 
Facsimile: (202)434-1501 
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A.. .PHOTOGRAPHING DIRECTION 

(57) Abstract: An apparatus (1) for photographing an object by focusing the light reflected off the object by means of an image 
sensor (212) which is provided with a range sensor (27) for measuring the distance between the object and the photographing ap- 
paratus (1), and means for controlling the exposure time of the image sensor (212) depending on the measurements at the time of 
photographing. 
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IMAGE TAKING DEVICE, IMAGE TAKING METHOD AND COMPUTER PROGRAM 



TECHNICAL FIELD 
The present invention relates to a noncontact type 
5 image taking device, 

BACKGROUND ART 
Conventionally, there is a technique proposed for 
identifying a person and authenticating the person in 

10 accordance with a physical characteristic of a human body. A 
physical characteristic obtained by an image taking device is 
compared with a physical characteristic that is registered in 
advance, so that the personal identification or the personal 
authentication is performed. 

15 Image taking devices can be divided broadly into a 

contact type in which the device touches the human body and a 
noncontact type in which the device does not touch the human 
body. A noncontact type is desired in a place where an 
indefinite number of people uses from viewpoints of resistance 

20 to soiling, a hygienic aspect and psychological inhibition. 

For example, if a contact type device is used for 
security of a facility, it is necessary to check every time 
whether or not a person who tries to enters the facility is 
permitted to enter. Namely, the device is frequently touched by 

25 people. Therefore, a glass face that is touched with a human 
skin may become dirty. As a result, the image taking process 
cannot be performed appropriately, and a correct result may not 
be obtained. For this reason, a noncontact type device is 
desired in a place where the authentication is performed 

30 frequently. 
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Similarly in the case where it is used for a control 
of entering and leaving a facility, image taking process should 
be performed ever time when a person enters or leaves the 
facility. In this case too, the contact type device is touched 
5 by people frequently. Therefore, a glass face that is touched 
with a hand may become dirty, so that the image taking process 
cannot be performed appropriately. In addition, a hygienic 
problem or a psychological inhibition may be caused about 
touching the dirty face. For this reason, a noncontact type 

10 device is desired. 

A noncontact type is preferred to a contact type also 
in the case where it is used in a place with a strict hygienic 
rule such as a medical institute or a research institute. In 
addition, needs of noncontact products are increasing recently 

15 as a social trend as understood from that various antibacterial 
goods and hygienic goods have becomes hit goods from viewpoints 
of a hygienic problem or a psychological inhibition. In the 
case of taking an image of a moving object, the contact type 
device cannot be used for such purpose. 

20 However, it is difficult to set a subject at the same 

position by the noncontact type device every time of taking an 
image. Therefore, luminance of an obtained image may vary every 
image taking process. In this case, it may be difficult to 
authenticate a person because of a mismatch between a pattern 

25 of the obtained image and a pattern of the image that was taken 
in advance. 

In addition, in the noncontact type device, a portion 
except the subject, i.e. a background portion may be included 
in the image. Then, it may be difficult to authenticate a 
30 person because of a mismatch between a pattern of the obtained 
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image and a pattern of the image that was taken in advance. 

There are proposed some methods for deleting a 
background portion, but each of them has a problem. For example, 
the method described in the patent document 1 below obtains 
5 movement information of an image by a differential between 
frames and accumulates the same, thereby determines that a 
pixel without any movement in a past predetermined period 
belongs to the background area for obtaining the background 
image. However, it is difficult in this method to distinguish 

10 the object from the background when the object having a uniform 
color, e.g., a white sheet of paper passes the front of a 
camera. The method described in the patent document 2 has a 
similar problem. 

The method described in the patent document 3 detects 

15 a depth of an image so that a foreground is separated from a 
• background in accordance with the depth. However, this method 
needs a device for detecting the depth that will be a large 
scale and expensive. The method described in the patent 
document 4 has a similar problem. 

20 An object of the present invention is to solve such 

problems by providing a noncontact type image taking device 
that can take an image of high accuracy easily. 

Patent document 1: 
25 Japanese unexamined patent publication No. 7-284086 

Patent document 2 

Japanese unexamined patent publication No. 2002- 

150294 

Patent document 3 
30 Japanese unexamined patent publication No. 5-95509 
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Patent document 4 

Japanese unexamined patent publication No. 2001- 

137241 



5 DISCLOSURE OF THE INVENTION 

An image taking device according to the present 
invention, which is an image taking device for taking an image 
of an object by focusing reflected light from the object on a 
light receiving portion, includes a measuring portion for 

10 measuring a distance between the object and the image taking 

device and an exposure control portion for controlling exposure 
time of the light receiving portion upon taking an image in 
accordance with the measurement result of the measuring portion. 

Moreover, an image sensor such as a CMOS sensor or a 

15 CCD is used as means for converting the received light into an 
electric signal. Instead of the exposure control portion, a 
gain control portion is provided for controlling an output gain 
of the image sensor in accordance with a measurement result of 
the measuring portion. 

20 Moreover, the device further includes a posture 

determining portion for determining whether or not the subject 
surface of the object is perpendicular to an axis along a 
shooting direction of the image taking device and an image 
taking control portion for controlling so as to taking an image 

25 of the object if it is determined by the posture determining 

portion that the subject surface of the object is perpendicular 
to an axis along the shooting direction of the image taking 
device. The measuring portion measures distances between the 
image taking device and at least two points in the subject 

30 surface of the object as the distance, and the posture 
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determining portion determines whether or not the subject 
surface of the object is perpendicular to the axis along the 
shooting direction of the image taking device in accordance 
with the measurement results of the measuring portion for the 
5 points . 

Moreover, the device further includes a guiding 
portion for guiding so that the subject surface becomes 
perpendicular to the axis along the shooting direction of the 
image taking device by producing different signs between the 

10 case where it is determined that the subject surface of the 
object is perpendicular to the axis along the shooting 
direction of the image taking device and the case where it is 
determined that the subject surface of the object is not 
perpendicular to the same. 

15 Moreover, the device further includes a still 

determining portion for determining whether or not the object 
is still in accordance with the measurement result of the 
measuring portion that is obtained at an interval of a 
predetermined time and an image taking control portion for 

20 controlling so as to take an image of the object if it is 

determined that the object is still by the still determining 
portion. 

Moreover, the device further includes a background 
storage portion for storing a background image without the 

25 object and an extracting portion for extracting an image that 

includes only the object by comparing the background image with 
an image obtained by taking an image of the object. The image 
taking control portion controls so as to take an image when the 
distance is not measured by the measuring portion for obtaining 

30 the background image. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a perspective view showing an overall 
structure of an image taking device. 
5 Fig. 2 is a cross section of the image taking device 

at the middle portion viewed from the side. 

Fig. 3 shows an example of a situation in taking an 
image of a left cheek. 

Fig. 4 shows an example of a connection between the 
10 image taking device and a personal computer. 

Fig. 5 is a block diagram showing an example of a 
functional structure of the image taking device. 

Fig. 6 shows a relationship between an output value 
of a distance measuring sensor and a real distance. 
15 Fig. 7 shows an example of a distance exposure table. 

Fig. 8 is a flowchart showing an example of a flow of 
a process when the image taking device takes an image. 

Fig. 9 shows an example of a program and data stored 
in a magnetic storage device. 
20 Fig. 10 shows an example of a characteristic 

information database. 

Fig. 11 is a flowchart showing an example of a flow 
of a personal discrimination. 

25 BEST MODE FOR CARRYING OUT THE INVENTION 

The present invention will be described in more 
detail with reference to the attached drawings. 

Fig. 1 is a perspective view showing an overall 
structure of an image taking device 1, Fig. 2 is a cross 
30 section of the image taking device 1 at the middle portion 
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viewed from the side, Fig, 3 shows an example of a situation in 
taking an image of a left cheek, Fig. 4 shows an example of a 
connection between the image taking device 1 and a personal 
computer 6, Fig. 5 is a block diagram showing an example of a 
5 functional structure of the image taking device, and Fig. 6 
shows a relationship between an output value of a distance 
measuring sensor 27 and a real distance. 

The image taking device 1 according to the present 
invention includes an image taking device main body 2 and a 

10 main body cover 3 as shown in Figs. 1 and 2. This image taking 
device 1 uses a lighting portion that emits infrared rays and a 
light receiving portion that receives reflected light of 
infrared rays. Thus, the image taking device 1 becomes a most 
suitable device for taking blood vessels of a human being or an 

15 animal. The lighting portion and the light receiving portion 
can be modified if necessary corresponding to a subject of 
image taking without limiting to those irradiating or receiving 
infrared rays. Hereinafter, the image taking device 1 will be 
described as a device for taking an image of blood vessels or 

20 the like of a human being or an animal. 

When taking an image, the main body cover 3 is 
attached to the front face 20a of the image taking device main 
body 2 in advance. If a left cheek of a human face is a subject 
for example, the left cheek is opposed to the front face of the 

25 image taking device 1 as shown in Fig. 3 so that the left cheek 
becomes parallel with the front face of the image taking device 
1 (namely, the left cheek that is a surface of the subject to 
be shot becomes perpendicular to an axis of shooting direction) . 
Then, a shutter is released. Hereinafter, an example will be 

30 described in which an image of a blood vessel pattern of a 



-8- 

human cheek is taken. 

The image taking device main body 2 includes a casing 
(enclosure) 20, an image taking portion 21, a circuit board 22, 
a lighting portion 23, an interface 24, a shutter button 25, a 
5 distance measuring sensor (distance sensor) 27 and a lamp 28. 
The image taking device main body 2 can be connected to a 
personal computer 6 via the interface 24 as shown in Fig. 4. 

The casing 20 has a box- like shape with an opened 
front face 20a. 

10 The image taking portion 21 includes a lens 211 and 

an image sensor 212. As the image sensor 212, a CCD type image 
sensor or a CMOS type image sensor can be used, for example. 

The circuit board 22 is provide with a control 
circuit for controlling each portion of the image taking device 

15 1 that will be described later and for D/A conversion, a ROM 
for storing a computer program (firmware) and data, and a CPU. 
The CPU performs operational processes in accordance with an 
instruction from the personal computer 6 or the shutter button 
25, the computer program, the data or the like. By this 

20 structure, the image taking device 1 realizes functions 

including a shutter control portion 201, an image processing 
portion 202, a position determining portion 203, a still 
determining portion 204, a distance calculating portion 205, a 
background image memory portion 206 and a posture determining 

25 portion 207 as shown in Fig. 5. 

The lighting portion 23 has LEDs as light sources. 
As the LEDs, those emitting infrared rays are used if the 
subject is a blood vessel. Current that is supplied to LEDs is 
obtained from the personal computer 6 via the interface 24. If 

30 USB is used as the interface 24, communication with the 
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personal computer 6 can be performed, and current can be 
supplied from the personal computer 6. 

Referring Figs. 1 and 2 again, the main body cover 3 
includes a filter plate 31 made of a synthetic resin plate or a 
5 glass plate, and a lens cover 32 made of a synthetic resin 

plate. The main body cover 3 is attached to the front face 20a 
of the casing 20 with screws (not shown) or the like. The 
filter plate 31 is made of a material that cuts visible light 
and light having shorter wavelengths (i.e., light having 

10 wavelengths less than approximately 800 nm) and passes infrared 
rays, for example. 

The distance measuring sensor 27, which is attached 
so as to be directed to the shooting direction, is used for 
measuring a distance between the distance measuring sensor 27 

15 itself and an object of taking an image, i.e., a subject. As 
the distance measuring sensor 27, an optical type or an 
ultrasonic type distance measuring sensor (distance sensor) is 
used. 

Furthermore, in this embodiment, the distance 
20 measuring sensor 27 that can measure three points on the 
surface of the subject (a subject surface) is used for 
determining a posture of the subject. Hereinafter, reference to 
a "distance to the subject (from the image taking device 1)" 
simply means an average value of distances between the image 
25 taking device 1 and the three points. 

As the relationship between the distance measuring 
sensor 27 and each portion of the image taking device 1 is 
known in advance, a distance between each portion of the image 
taking device 1 and the subject can also be determined in 
30 accordance with a distance obtained by the distance measuring 
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sensor 27. In this embodiment, a reference of a distance to the 
subject is defined as a front face 3c of the main body cover 3. 
Namely, a distance between the image taking device 1 and the 
subject is defined as a distance from the front face 3c of the 
5 main body cover 3 to the subject. 

The distance measuring sensor 27 is set so that 
distances can be measured for three points including a vicinity 
of the base of a ear, a vicinity of the tip of the zygomatic 
bone (a vicinity of the portion under the outer corner of the 

10 eye) and the corner of the mouth if the cheek that is a subject 
is located at the place a few centimeters away from the image 
taking device 1 (see Fig. 3). 

The distance between the image taking device 1 and 
one point on the subject is determined finally by the following 

15 method specifically. The distance measuring sensor 27 outputs a 
measured value of 8 bits, i.e., 256 gradation levels as a 
result of measurement of distance to one or more points on the 
surface of the subject (subject surface). 

A relationship between a measured value (output 

20 value) and a real distance depends a little on a type of the 
subject, and has a tendency that the real distance to the 
subject becomes shorter as the measured value increases. For 
example, when a surface of a human body is measured, a 
relationship between a measured value and a real distance 

25 becomes as shown in the function "D = F(x)" as shown in Fig. 6. 
This function is obtained by real measurement while changing a 
position of the cheek little by little. Then, a distance 
between the image taking device 1 and one point on the subject 
is determined by assigning the measured value into the function 

30 corresponding to a type of the subject. 
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The distance calculating portion 205 shown in Fig. 5 
calculates distances between the image taking device 1 and 
three points on the cheek by the method described above, namely 
in accordance with the function shown in Fig. 6 and the 
5 measured values (output values) about the three points on the 
cheek. The calculation result is given to the shutter control 
portion 201, the position determining portion 203 and the 
posture determining portion 207 as subject distance information 
70. 

10 The shutter control portion 201 instructs LED driving 

portions 261 and 262 to start supplying current to the LEDs 
51a-51d and 52a-52d at the moment when the shutter button 25 is 
pressed and the shutter is released. Then, it instructs to stop 
the supply of current in accordance with an exposure time. Thus, 

15 each of the LEDs emits light in synchronization with the 

shutter release and the shutter speed (exposure time). Note 
that it is possible that the instruction for releasing the 
shutter is performed by the personal computer 6 instead of the 
shutter button 25. 

20 When the shutter is released and each of the LEDs 

emits light, the light is irradiated to the cheek that is a 
subject. However, visible light and the like are cut by the 
filter plate 31, so only infrared rays are irradiated to the 
subject. In general, a blood vessel of a human being or an 

25 animal has characteristic of absorbing infrared rays. Therefore, 
a part of the surface of the cheek where blood vessels exist 
under the skin does not reflect the infrared rays so much, 
while a part without blood vessels reflects the infrared rays 
well. 

30 The reflected light from the subject passes through 
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the filter plate 31, enters the casing 20, and is focused by 
the lens 211 on the image sensor 212. The image sensor 212 
converts the light to a signal so as to produce an image data. 

The image processing portion 202 performs image 
5 processing on the image data so as to generate an image of a 
blood vessel pattern of the cheek. Note that it is possible to 
perform the image processing in the personal computer 6 . 

The shutter may be a mechanical shutter such as a 
lens shutter or a screen shutter, or an optical shutter such as 

10 a liquid crystal shutter. In addition, it is possible to start 
accumulation of charge by the image sensor 212 in 
synchronization with an instruction of taking an image and to 
finish the accumulation of charge or read the accumulated 
charge after the exposure time, for example. Namely, the 

15 exposure time in this structure means an accumulation time. 
Alternatively, it is possible to combine the mechanical, the 
optical and the electrical shutters. 

The image taking device 1 is provided with a function 
for controlling the exposure and the shutter automatically, 

20 guiding a position and a posture of the subject, and extracting 
em area of the subject. By using these functions, an image can 
be taken more easily and in a high accuracy. Next, these 
functions will be described. 

[Automatic exposure adjustment function] 

25 Fig. 7 shows an example of a distance exposure table 

TL1. The image taking device 1 is provided with the distance 
exposure table TL1 as shown in Fig. 5. The distance exposure 
table TL1 defines exposure times corresponding to a distance 
between the image taking device 1 and the subject as shown in 

30 Fig. 7. As understood from Fig. 7, the exposure time is set to 
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a longer value as the distance between the image taking device 
1 and the subject (the cheek) becomes longer. For example, if 
the distance to the image taking device 1 is 2.5 cm, the 
exposure time is set to 80 milliseconds. If it is 8.5 cm, the 
5 exposure time is set to 95 milliseconds. 

Note that a "gain" in the distance exposure table TL1 
indicates an output gain of the output signal S10 that is 
output from the image sensor 212 to the image processing 
portion 202. In Fig. 5, the adjustment signal Sll for adjusting 

10 the output gain is transmitted from the shutter control portion 
201 or the like in accordance with the distance exposure table 
TL1 . In addition, it is possible to adjust the output gain 
manually. An amplifier 208 amplifies the output signal S10. It 
is possible to eliminate the amplifier 208. It is possible that 

15 a gain of the amplifier 208 is variable and the gain is 

adjusted by the adjustment signal Sll so as to adjust the 
output gain of the output signal S10. In this case, it is 
possible to structure the amplifier 208 integrally inside the 
image sensor 212. Note that if the output signal S10 is digital 

20 data, a data converter may be used instead of the amplifier 208. 
In this example, the output gain is set to the same value 
despite the distance. 

The shutter control portion 201 shown in Fig. 5 sets 
the exposure time in accordance with a distance to the subject 

25 calculated by the distance calculating portion 205 and the 
distance exposure table TL1 when an image is taken. 

[Automatic shutter control function] 

The shutter control portion 201 gives an instruction 
to take an image automatically when the position and the 
30 posture of the subject become suitable for taking an image. 
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More specifically, the instruction to take an image is given 
when three conditions are satisfied, which include a condition 
that the subject (the cheek) is positioned in a good shooting 
range, a condition that the cheek is in the posture to be 
5 opposed to the front face of the image taking device 1 in 

parallel (an axis along the shooting direction is substantially 
perpendicular to the plane of the cheek) , and a condition that 
the cheek is static. Note that the "good shooting range" means 
a range for taking an image having clarity higher than a 

10 predetermined level. Determination whether or not these 
conditions are satisfied is performed by the position 
determining portion 203, the still determining portion 204 and 
the posture determining portion 207 as follows. 

The position determining portion 203 determines 

15 whether or not the subject (the cheek) is within the good 

shooting range of the image taking device 1 in accordance with 
the subject distance information 70 or the output value of the 
distance measuring sensor 27. The good shooting range for the 
cheek is the range where the distance from the image taking 

20 device 1 in the shooting direction is within the range of 2-9 

cm, for example. Note that it is possible to determine it is in 
the good shooting range if all the three points on the cheek 
are in the good shooting range. It is also possible to 
determine it is in the good shooting range if one of the points 

25 is in the good shooting range. Such determination is performed 
at a predetermined time of interval (for example, 50 
milliseconds ) . 

The posture determining portion 207 obtains 
coordinates of the three points on the subject in accordance 

30 with the subject distance information 70 or the output value of 
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the distance measuring sensor 27. Then, the posture determining 
portion 207 determines whether or not the axis along the 
shooting direction of the image taking device 1 is 
perpendicular to the plane including the three points on the 
5 subject. Namely, it determines whether or not the plane is 
parallel with the front face 20a of the image taking device 1 
and the subject surface of the subject faces the image taking 
device 1 straightly. However, the term "perpendicular" in the 
above description means substantially perpendicular without 

10 limiting to the state perpendicular exactly by 90 degrees. For 
example, it is determined that the axis along the shooting 
direction is perpendicular to the subject surface and that the 
subject faces the image taking device 1 straightly if the angle 
between them is within a predetermined range , e.g., 

15 approximately 90±10 degrees. Otherwise, it is determined that 
the axis along the shooting direction is not perpendicular to 
the subject surface and that the subject does not face the 
image taking device 1 straightly. 

The still determining portion 204 determines whether 

20 or not the subject that entered the good shooting range becomes 
still. Namely, it obtains the measured value of 8 bits about 
the three points on the subject from the distance measuring 
sensor 27 once every predetermined time (for example, 100 
milliseconds ) . It observes variation of the measured value of 

25 each of the points for a predetermined period (for example, a 
few hundred milliseconds to a few seconds). Then, if the 
variation is smaller than a predetermined value for all period, 
it is determined that the subject is still. If it exceeds the 
predetermined value during the period, it is determined that 

30 the subject is not still. Alternatively, it is possible to 
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det ermine whether or not the subject is still by observing the 
variation in the same manner as described above in accordance 
with the subject distance information 70 of the subject 
obtained from the distance calculating portion 205. 
5 If it is determined that all the conditions are 

satisfied as results of these determinations, the shutter 
control portion 201 performs the automatic shutter control 
function. The exposure time in this case is an exposure time 
that is determined in accordance with a latest measured value 
10 (output value) by the distance measuring sensor 27. 

[Guiding function of a position and a posture of the 

subject] 

As described above, taking of an image by the 
automatic shutter control function is performed only when the 

15 subject (the cheek) is a position within the good shooting 

range, and is a posture that is parallel with the image taking 
device 1 (a posture in which the axis along the shooting 
direction is perpendicular to the subject surface) and is still. 
In order to satisfy these three conditions easily, the lamp 28 

20 issues a sign for guiding the subject to a correct position and 
posture. 

For example, the lamp 28 is turned off during the 
subject is not detected by the distance measuring sensor 27. 
When the subject is detected and is determined to enter the 

25 good shooting range by the position determining portion 203, 
the lamp 28 is made blink slowly (for example, every one 
second) . When the posture determining portion 207 determines 
that a posture of the subject becomes straight to the image 
taking device 1, blinking speed the lamp 28 is increased (for 

30 example, every 0.5 seconds). When the still determining portion 
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204 determines that the subject becomes still, the lamp 28 is 
made stop blinking and stay on. Alternatively, three lamps may 
be prepared for the three conditions, respectively. Then, if a 
condition is satisfied, the corresponding lamp is turned on. 
5 It is possible to provide a speaker to the image 

taking device 1 instead of the lamp 28 and to produce a sound 
message like "Please don't move" or "Please turn your face a 
little to the left" so as to guide the position and the posture 
of the subject. Alternatively, it is possible to provide a 
10 liquid crystal panel and to display a message, a figure, a 

picture, a photograph or an image for guiding. It is possible 
to use a speaker or a display device of the personal computer 6 
for guiding. 

[Extraction of the subject (a process of removing a 

15 background)] 

If the image taking device 1 is substantially close 
to the subject, an image of the subject without other objects, 
i.e., without a background can be obtained. However, if a 
distance between them is large to some extent, or if the 

20 subject is small, the obtained image may include a background. 
Therefore, each portion of the image taking device 1 performs 
the following process for extracting the area of the subject. 

During the distance measuring sensor 27 does not 
detect the subject, the shutter control portion 201, the image 

25 processing portion 202 and the image taking portion 21 performs 
a process for taking an image of the background. This process 
is performed regularly (for example, every few minutes to every 
few tens of minutes). The obtained image is stored and 
accumulated as background image data 80 in the background image 

30 memory portion 206. Note that if the background image data 80 
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are already accumulated, the old background image data 80 are 
deleted and new background image data 80 are accumulated. 

The automatic shutter control function and others 
perform the process of taking an image of the subject, and an 
5 area of blood vessels included in the obtained image is 

extracted in accordance with the background image data 80. 
Namely, corresponding pixels are compared between the obtained 
image and the background image. If the difference between the 
pixels is above a predetermined threshold level, it is 

10 determined that the pixel belongs to the image of the subject. 
Otherwise, it is determined that the pixel belongs to the image 
of the background. Thus, the area of the cheek that is a 
subject is extracted. 

Fig. 8 is a flowchart showing an example of a flow of 

15 a process when the image taking device 1 takes an image. Next, 
when using functions described above including automatic 
exposure adjustment, automatic shutter control, guiding of the 
position and the posture, and extracting of the area of the 
subject, a flow of the process in the image taking device 1 

20 will be described with reference to a flowchart shown in Fig. 8. 

An operator operates operational buttons of the image 
taking device 1 or a keyboard of the personal computer 6 so as 
to switch the image taking device 1 to an automatic shooting 
mode (#1). Then, the distance measuring sensor 27 is activated 

25 (#2) and starts measuring a distance between the image taking 
device 1 and an object placed at the front face thereof (#3). 
Note that the measurement is repeated until the exposure time 
is calculated (#7) or the process is finished at a 
predetermined time interval (for example, every 100 

30 millisecond) . 
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If there is a change in the measurement result, it is 
determined that an object person appeared at the front face of 
the image taking device 1 (Yes in #4). The object person makes 
his or her cheek close to the front face of the image taking 
5 device 1. The image taking device 1 determines whether the 
position and the posture of the cheek become suitable for 
taking an image (#5). 

If they are not suitable position and posture for 
taking an image (No in #5), the lamp 28 or a speaker is used 

10 for guiding the cheek to the suitable position and posture (#6). 
Then, the determination is repeated until the position and the 
posture of the cheek becomes suitable. 

If all these conditions are satisfied (Yes in #4 and 
Yes in #5), the distance exposure table TL1 is referred for 

15 determining the exposure time (#7). Then, the distance 

measuring sensor 27 is stopped (#8), and an image of the cheek 
is taken in accordance with the calculated exposure time so as 
to obtain an image including the cheek (#9). 

If a cheek does not appear at the front face of the 

20 image taking device 1 and an instruction is issued to stop 
taking an image (No in #4 and Yes in #11), the distance 
measuring sensor 27 is stopped (#12) and the automatic shooting 
process is stopped. If a cheek does not appear at the front 
face of the image taking device 1 but there is no instruction 

25 to stop taking an image (No in #4 and No in #11), an image of 
the background is taken if necessary (for example, if a few 
minutes have passed since the last time of taking an image of 
the background ) (#13). 

After obtaining the image including the cheek in Step 

30 #9, an image that includes only the cheek is extracted from the 
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image (#10). 

[Personal recognition process] 

Fig. 9 shows an example of a program and data stored 
in a magnetic storage device 6d, Fig. 10 shows an example of a 
5 characteristic information database 6DB, Fig. 11 is a flowchart 
showing an example of a flow of a personal discrimination. 

Following description is a case where the image 
taking device 1 is used for personal recognition process. For 
example, a case will be described in which a process of logging 

10 on the personal computer 6 shown in Fig. 4 is exemplified. 

The magnetic storage device 6d in the personal 
computer 6 stores the characteristic information database 6DB 
as shown in Fig. 9. This characteristic information database 
6DB stores characteristic information 71 (71a, 71b, ...) of each 

15 user in connection with a user ID for discriminating the user 
as shown in Fig. 10. 

The characteristic information 71 is information 
about characteristics of each user. In this embodiment, 
information about blood vessels in the left cheek is used as 

20 the characteristic information 71. The characteristic 

information 71 is obtained in advance by taking an image of the 
left cheek of each user by the image taking device 1. It is 
possible to store the characteristic information 71 as an image 
of the blood vessel pattern, or as information indicating 

25 characteristics such as a thickness, a length, the number or an 
arrangement of blood vessels that is obtained by analyzing the 
image. 

In addition, a personal discrimination program 6PG is 
installed in the magnetic storage device 6d. Performing this 
30 program, a process for determining which user is logging on is 
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realized by the process as shown in the flowchart in Fig. 11. 

A user who wants to use the personal computer 6 turns 
on the switch of the personal computer 6. Then, a log- on screen 
is displayed on the personal computer 6. Here, the user enters 
5 his or her user ID (#21), and lets the image taking device 1 
take an image of his or her left cheek (#22). The entered user 
ID and image data obtained by taking the image are transmitted 
to the personal computer 6 . 

The personal computer 6 searches characteristic 

10 information 71 corresponding to the user ID from the 

characteristic information database 6DB (#23). Then, the 
personal computer 6 determines whether or not the user is a 
regular user by determining whether or not the characteristics 
of blood vessels indicated by the characteristic information 71 

15 match the characteristics of blood vessels indicated by the 
image data obtained by taking the image (#24). 

If it is determined that the user is a regular user 
(Yes in #25), the user can log on for using the personal 
computer 6 (#26). If the user is not determined to be a regular 

20 user (No in #25) , a message indicating that the user cannot log 
on and urging the user to operate again is displayed (#27). 

Alternatively, it is possible that the personal 
computer 6 discriminates who is the user by performing the 
process in Step #24 sequentially for the characteristic 

25 information 71a, 71b, ... stored in the characteristic 

information database 6DB, so as to determine to permit the log- 
on or not. In this case, it is not necessary to enter the user 
ID in the log-on screen. 

The application of the personal discrimination is not 

30 limited to the user check for log-on as described above, but it 



can also be performed for personal authentication in payment by 
an electronic payment system or in checking the times of 
arrival and departure (as a time card), for example. 

According to this embodiment, a precise image can be 
5 taken even by a noncontact type device by adjusting exposure to 
light in accordance with a distance between the image taking 
device and the subject. By guiding the subject to a position 
and a posture suitable for taking an image, a more precise 
image can be taken. In addition, an image that includes only 

10 the subject without a background can be extracted more 

correctly and inexpensively than the conventional device. 

Although the exposure time is set to a larger value 
as a distance to the subject is larger and the gain of the 
output of the image sensor 212 is set to a constant value 

15 regardless of the distance as shown in Fig. 7 in this 

embodiment, it is possible to set the gain to a larger value as 
the distance is larger and to set the exposure time to a 
constant value. Alternatively, it is possible to change the 
both. 

20 It is possible to take the image of the background 

just after taking the image of the subject. Namely, it is 
possible to take the image of the background when the distance 
measuring sensor 27 becomes not to detect the subject after 
taking the image of the subject. It is possible to move the 

25 image taking device 1 so as to adjust the relationship between 
positions of the subject and the image taking device 1 if the 
subject is not in the position and the posture suitable for 
taking an image. It is possible to use CCD instead of the CMOS 
sensor as the image sensor 212. 

30 Though an image of a blood vessel pattern of a cheek 



of a human being is taken by the image taking device 1 in this 
embodiment, it is of course possible to take an image of other 
part of a human or an animal body. It is possible to take an 
image of various surface of a forehead, a head portion, an 
5 abdomen, a back, a hip, a neck, a limb, an, and a leg and other 
parts, for example. In this case, a condition such as an 
arrangement of LEDs, an intensity of LEDs, an adjustment of the 
automatic exposure, a position or a posture is changed in 
accordance with the part to be an object of taking an image, so 

10 as to structure the image taking device 1. 

It is possible to take an image of an object other 
than a human being or an animal. For example, it is possible to 
use the image taking device 1 for a survey on traffic of 
automobiles. In this case, the system may be structure as 

15 follows. 

The image taking device 1 is placed at the side of 
the road (on a sidewalk). The shooting direction is set to face 
the other side of the road. The good shooting range is set to 
the range from one side to the other side of the road. Images 

20 of cars are prepared for each type in the database. 

As the light source that is used for the lighting 
portion 23, a usual strobe light for a camera is used, for 
example. In this case, the filter plate 31 is a transparent 
place. The table for determining a condition of the automatic 

25 exposure (see Fig. 7) is changed in accordance with a width of 

the road and an environment for taking an image. The timing for 
lighting may be just after it is determined that a car is 
approaching. It is possible to change the intensity of light in 
inverse proportion to the distance to a car. Other than that, 

30 the structure of the image taking device 1 is changed in 
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accordance with a width of the road and the environment for 
taking an image. 

If the distance measuring sensor 27 does not detect a 
car, the image of the background is obtained regularly. When 
5 the distance measuring sensor 27 detects a car and it is 

determined that the car is approaching, a distance to the car 
is determined for deciding an exposure time in accordance with 
the distance. An image of a car is taken by the exposure time 
so that the image is obtained. Only a part of the car is 

10 extracted from the obtained image. 

The extracted image of the car is compared with each 
of the images prepared in the database about characteristic 
information such as color information component, an edge 
component or a face component, so that a type of the detected 

15 car is specified. Then, the data of traffic are updated. 

Alternatively, it is possible to take a three-dimensional image 
and to specify a type of the car by comparing characteristic 
information of appearance image information reproduced from 
three-dimensional structural information, or a color 

20 information component, an edge component, or a face component. 

In the same manner as the survey on traffic of 
automobiles, it is possible to carry out a survey on the number 
of people who walk along a corridor or a pavement. In this case, 
a range between both side walls of the corridor or a range of a 

25 width of the road is considered as the good shooting range. The 
image taking device 1 may be placed on the wall or the like, 
while the distance measuring sensor 27 may be placed at the 
vicinity of footing. In addition, the structure of the image 
taking device 1 or others may be changed in accordance with 

30 these conditions. Alternatively, in order to recognize a person 
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in front of a door such as an automatic door for example, a 
range from the door to the wall is regarded as the good 
shooting range and the image taking device 1 is placed at the 
upper portion of the door. The structure of the image taking 
5 device 1 or others may be changed in accordance with these 
conditions . 

There may be a case where though it was detected that 
the object to be shot was approaching, the object has passed 
when an image is taken. Namely, it is the case where an error 

10 of taking an image occurs. In this case, in order to reduce 
process errors afterward, it is possible to perform the 
following process. When an image of the object is taken, the 
distance measuring sensor 27 obtains a position (a distance) of 
the object again. As a result, if the position of the object is 

15 not within the good shooting range, it is high probability that 
the image was taken after the object has passed. Therefore, in 
this case, the obtained image is compared with the background 
image so as to determine whether or not the object is in the 
image. If the object is not in the image, it is regarded that 

20 the object was not approaching. 

Though distances between the image taking device 1 
and three points on the subject in this embodiment, it is 
possible to measure distances to one or two points. For example, 
if the object can stand straight like a suit case when taking 

25 an image, distances between the image taking device 1 and two 

points on the subject may be measured. It is because that it is 
detected that the image taking device 1 is parallel with the 
subject if a distance to one point on the surface of the 
subject (the subject surface) is equal to a distance to another 

30 point. Alternatively, in order to take an image of a car 



running on the road, it is sufficient to measure for one point. 
It is because a car runs substantially in parallel with the 
image taking device 1 . 

It is possible to output the recognition result of a 
person or a type of an object (a type of cars, for example) by 
a display device or a printer device. It is possible to 
transmit the result to other electronic system or device via a 
network, or to record the result in a recording medium. It is 
possible to draw an illustration on the surface of the main 
body cover 3 for indicating the shooting direction. For example, 
if the image taking device 1 takes an image of a sole, an 
illustration of a foot may be drawn on the surface of the main 
body cover 3 . 

Furthermore, the structure of the entire or each part 
of the image taking device 1, the object of taking an image, 
the arrangement and intensities of the LEDs, the arrangement of 
the optical system including the lens, the contents of the 
processes, the order of the processes, the contents of the 
database, the structure of the screens and others can be 
modified if necessary in accordance with the spirit of the 
present invention. 

INDUSTRIAL APPLICABILITY 
As described above, the present invention is useful 
in that even a noncontact type device can take a precise image 
by adjusting exposure to light in accordance with a distance 
between the image taking device and the subject. 
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1 . An image taking device for taking an image of an 
object by focusing reflected light from the object on a light 

5 receiving portion, comprising: 

a measuring portion for measuring a distance between 
the object and the image taking device; and 

an exposure control portion for controlling exposure 
time of the light receiving portion upon taking an image in 
10 accordance with the measurement result of the measuring portion. 

2. An image taking device for taking an image of an 
object by focusing reflected light from the object on a light 
receiving portion that converts the light into an electric 
signal, comprising: 

15 a measuring portion for measuring a distance between 

the object and the image taking device; and 

a gain control portion for controlling an output gain 

of the electric signal in accordance with the measurement 

result of the measuring portion. 
20 3. The image taking device according to claim 1 or 2, 

further comprising : 

a posture determining portion for determining whether 

or not the subject surface of the object is perpendicular to an 

axis along a shooting direction of the image taking device; and 
25 an image taking control portion for controlling so as 

to taking an image of the object if it is determined by the 

posture determining portion that the subject surface of the 

object is perpendicular to an axis along the shooting direction 

of the image taking device, wherein 
30 the measuring portion measures distances between the 
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image taking device and at least two points in the subject 

surface of the object as the distance, and 

the posture determining portion determines whether or 

not the subject surface of the object is perpendicular to the 
5 axis along the shooting direction of the image taking device in 

accordance with the measurement results of the measuring 

portion for the points. 

4 . The image taking device according to claim 3 , 

further comprising a guiding portion for guiding so that the 
10 subject surface becomes perpendicular to the axis along the 

shooting direction of the image taking device by producing 

different signs between the case where it is determined that 

the subject surface of the object is perpendicular to the axis 

along the shooting direction of the image taking device and the 
15 case where it is determined that the subject surface of the 

object is not perpendicular to the same. 

5. The image taking device according to claim 1 or 2, 
further comprising: 

a still determining portion for determining whether 
20 or not the object is still in accordance with the measurement 
result of the measuring portion that is obtained at an interval 
of a predetermined time; and 

an image taking control portion for controlling so as 
to take an image of the object if it is determined that the 
25 object is still by the still determining portion. 

6. The image taking device according to claim 1 or 2, 
further comprising: 

a background storage portion for storing a background 
image without the object; and 
30 an extracting portion for extracting an image that 
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includes only the object by comparing the background image with 
an image obtained by taking an image of the object, wherein 

the image taking control portion controls so as to 
take an image when the distance is not measured by the 
5 measuring portion for obtaining the background image. 

7 . An image taking device for taking an image of a 
blood vessel pattern of a body, comprising: 

a lighting portion for irradiating infrared rays to 

the body; 

10 a light receiving portion for receiving reflected 

light of the infrared rays from the body; 

a measuring portion for measuring a distance between 
the body and the image taking device; 

an exposure control portion for controlling so that 
15 exposure time of the light receiving portion upon taking an 

image becomes longer as the distance measured by the measuring 
portion is longer. 

8 . A method for taking an image of an object by 
using an image taking device that focuses reflected light from 

20 the object on a light receiving portion, the method comprising 
the steps of : 

measuring a distance between the object and the image 
taking device; and 

controlling exposure time of the light receiving 
25 portion upon taking an image in accordance with the measurement 
result . 

9. A computer program for controlling an image 
taking device including a light receiving portion for receiving 
reflected light from an object and a distance measuring sensor, 

30 the computer program makes a computer execute the processes 
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comprising: 

a process for making the distance measuring sensor 
measure a distance between the object and the image taking 
device ; and 

a process for controlling exposure time of the light 
receiving portion upon taking an image in accordance with the 
measurement result. 
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ABSTRACT OF THE DISCLOSURE 



An image taking device ( 1 ) , which takes an image of 
an object by focusing reflected light from the object on an 
5 image sensor (212), is provided with a distance measuring 

sensor (27) for measuring a distance between the object and the 
image taking device ( 1 ) , and means for controlling exposure 
time of the image sensor (212) upon taking an image in 
accordance with a measurement result- 
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any foreign appEcation for patent or hventor* s certificate, or PCT 
International application havhg a fffing date before that of the 
appEcation for which priority b claimed 


Prior Foreign Application(s) 


Priority Not Claimed 

n 


(Number) (Country) 
«*) 


(Day/Month/Year Filed) 

n 


(Number) (Country) 


(Day/Morrth/Year Red) 


I»B3 5ffil 1 9*(e)35^flJJfcS:±36ra. 


I hereby clam the benefit under Tide 35, United States Code, Section 
1 1 9(e) of any United States provisional applications) listed below. 


(Application No.) (Filing Date) 

(ajs#-so cause) 


(Application No.) (Filing Date) 


ommi 2 0^Llo< ^Jffi5:±5ftL^ X^III^tBAii ? 3 v^5* 
ft*PCTSII8tMStColvrfc. 3 6 5^(c){Cg-^<flJ^ 

3 5*6Jgi 1 2**iaic«j6§*tfciwiT, 3fefTra*@a«xtt 

PCTg^tB0tc|^^$^Ti/^^v^^tc*5V>Tii, ^(D9cftftm<D 

£tit^nT\ mmmm&m 3 7H^iu 1. 56 ^^^n^^ff 


l hereby claim the benefit under Trtle 35, United States Code, Section 
idv or any unrted states applications s;, or oooCc; of any PCT 
bTtemational appfication designating the United States, Bsted below 
and insofar as the subject matter of each of the claims of this 
appfication is not disclosed h the prior United States or PCT v 
International application h the manner provided by the frst paragraph 
of Title 35, United States Code Section 112. 1 acknowledge the duty 
to disclose information which is material to patentability as defoed in 
Title 37, Code of Federal Regulations, Section 1.56 which became 
available between the fifrig date of the prior appfication and the 
national or PCT bTtemational ting date of appfication. 


PCT/JP03/03987 Mar. 28, 2003 


Pending 


(Application No.) (Filing Date) 


(Status: Patented, Pending, Abandoned) 


(Application No.) (Filing Date) 


(Status: Patented, Pending, Abandoned) 


lo^i tfrf a ^ t < mmK iure&£ ttBz htiz c t 

^18^100 P^fcli^^, *L<tt-ttf>Pi# 
•fart LTtJiT^^tT^n^ r t lc^Wi-* 0 


l hereby declare that all statements made herein of my own 
knowledge are true and that aD statements made on ^formation 
and belief are believed to be true; and further that these statements 
were made with the knowledge that willful false statements and the 
Ike so made are punishable by frie or imprisonment, or both, under 
Section 1001 of Title 18 of the United States Code and that such 
wflHul false statements may jeopardize the validity of the application 
or any patent issued thereon. 
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Japanese Language Declaration 



POWER OF ATTORNEY; As a named rrventor. I hereby appoht 
the following attorneys) and/or agentCs) to prosecute this 

application and transact aD business in the Patent and Trademark Office 

connected therewith (fist name and registration number). 

The attorneys and agents of Staas & Halsey LLP under 
USPTO Customer No. 21,171. 



Send Correspondence to: 




21171 

PATENT TRADEMARK OFFICE 



Direct Telephone Calls to: (name and telephone number) 

Telephone: 202-434-1500 
Facsimile: 202-434-1501 







Full name of sole or first inventor 
Satoshi FUKUI 








Inventor* s signature 


Date 






Residence 
Kato, Japan 




mm 




Citizenship 
Japan 





M&tOtuJt " "* ~ " Post Office Address 

c/o FUJITSU PERIPHERALS LIMITED, 



35, Saho, Yashiro-cho, Kato-gun, Hyogo 673-1 447 Japan 







Fuii name of second joint inventor, if any 
Takayuki SUGIURA 




art- 


Second inventor* s signature Date 


<m 




Residence 
Kato. Japan 


mm 




Citizenship 

Japan { 



W&-<O^Jt Post Office Adcfress 

c/o FUJITSU PERIPHERALS LIMITED, 



35, Saho, Yashiro-cho, Kato-gun, Hyogo 673-1447 Japan 



(^^J^T^^R^^#!coV>T £>fRl1§{Cf£ifc H£ (Supply similar information and signature for third and subsequent 

i"5^.£) joint inventors.) 
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Full name of third joint inventor, if any 
Atsushi MIK] 






third inventor* s signature Date 

(Xt£usJ)i Aj.'itf J*fnforV ^c^<- 






Residence ' 
Kato, Japan 


KfS Citizenship 

Japan 






Post Office Address 

c/o FUJITSU PERIPHERALS LIMITED, 


35, Saho, Yashiro-cho, Kato-gun. Hyogo 673-1 447 Japan 






Full name of fourth joint inventor, if any 
Shuji KIMURA 




0# 


fourth inventor' s signature Date 






Residence 
Kato, Japan 


IS^b Citizenship 

Japan 






Post Office Address 

c/o FUJITSU PERIPHERALS LIMITED, 


35, Saho, Yashiro-cho, Kato-gun, Hyogo 673-1 447 Japan 






Full name of fifth joint inventor, if any 
Kryoshi CHJNZEI 






fifth inventor s signature ^ '« Date 

/fW#SrM Tk^lA. X>& 


&m 




Residence ' / 


mm 




Citizenship | 
Japan 






Post Office Ad*e SS e/£> h 1/ 'A/MM 
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Full name of sixth joint inventor, if any 

IVJieKO IMrWMML/ 






sixth inventor' s signature Date 






Residence 
Kato, Japan 






Citizenship 
Japan 






Post Office AdoVess 

c/o FUJITSU PERIPHERALS LIMITED, 


35, Saho, Yashiro-cho, Kato-gun, Hyogo 673-1 447 Japan 






Full name of seventh joint inventor, if any 
Naoyuki FUJIMOTO 




Hft 


seventh inventor s signature Date 


&m 




Residence 
Kato, Japan 


mm 




Citizenship 
Japan 






Post Office Address 

c/o FUJITSU PERIPHERALS LIMITED, 


35, Saho, Yashiro-cho, Kato-gun, Hyogo 673-1447 Japan 






Full name of eighth joint inventor, if any 
Mitsuhiro GOTOH 




— s¥ 


eighth inventor s signature Date 

^l^xJ^rGifCb^. /f 2-oof 


im 




Residence 
Kato, Japan 


HIS 




Citizenship 
Japan 






Post Office Address 

c/o FUJITSU PERIPHERALS LIMITED, 


35, Saho, Yashiro-cho, Kato-gun, Hyogo 673-1447 Japan 
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Full name of ninth joint inventor, if any 
Toshio ENDOH 






ninth inventor s signature Date 

^U.-Vt^ 7tm.\i me r 






Residence 
Kawasaki, Japan 


Citizenship 
Japan 






Post Office Adcfress 

c/o FUJITSU LIMITED, 1-1, Kamikodanaka 4-chome, 


Nakahara-ku, Kawasaki-shi, Kanagawa 211-8588 Japan 






Full name of tenth joint inventor, if any 
Takahiro A0K1 






tengi inventor s signature Date 


Residence S " 
Kawasaki, Japan 


m ^ Citizenship 

Japan 






Post Office Address 

c/o FUJITSU LIMITED, 1-1, Kamikodanaka 4-chome, 


Nakahara-ku, Kawasaki-shi, Kanagawa 211-8588 Japan 






Full name of eleventh joint inventor, if any 
Mitsuaki FUKUDA 






eleventh inventor s signature Date 


Residence ' W 

Kawasaki, Japan 


S ® Citizenship 

Japan 


mW<D*±9£ p ost Address 

c/o FUJITSU LIMITED, 1-1, Kamikodanaka 4-chome. 


Nakahara-ku, Kawasaki-shi, Kanagawa 211-8588 Japan 
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Full name of twelfth joint inventor, if any 
Masaki WATANABE 








—twelfth inventorle-^ignatur 

IAao-JL; u 


>- - Date 








Residence 
Kawasaki, Japan 




. Citizenship 

Japan 








Post Office Adcfr-ess 

c/o FUJITSU LIMITED, 1-1, Kamikodanaka 4-chome, 


Nakahara-ku, Kawasaki-shi, Kanagawa 21 1-8588 Japan 








Full name of thirteenth joint inventor, if any 
Shigeru SASAKI 








^tt imle/nth inve^>r^s^gnature/ ^ Date 


Residence p " ' — 5 

Kawasaki, Japan 








Citizenship 
Japan 










Post Office AdoVess 
c/o FUJITSU LIMITED, 


1-1, Kamikodanaka 4-chome, 


Nakahara-ku, Kawasaki-shi, Kanagawa 211-8588 Japan 








Full name of fourteenth joint inventor, if any 








fourteenth inventor s signature Date 


Residence 


S ^ Citizenship " " 


Post Office Address ' 
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